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Three  types  of   items were  developed:     (1)  computer   literacy  self-
survey   items   including  (a)   self-assessment   items   for which   Che   individual
reports  his  or  her  own  level   of knowledge  or   skill,   (b)   self-report   items
for which  the   individual  describes his   or her own behavior   (e.g.,   frequency
of  using a computer),   and  (c)  expert  report   items   for which   the   individual
serves  as  an   informant   (e.g.j  he  or   she   indicates whether  or  not. his  or
her district  has  policies  related  to  computers);   (2)   computer   literacy
validation  items,   which are multiple-choice  questions   for  each  computer
literacy domain;   and  (3)  computer-related  resource   inventory  questions.
Computer  literacy   survey   items   and  computer  related  resource   inventory
questions were  developed   as checklists,   ratings,   rankings,   and   simple
"Yes-No" questions.

Preliminary versions of  all   items  were  reviewed,   revised,   and   refined,
over multiple   iterations,   by  the  project   staff and  the Advisory Panel.      In
developing  and  reviewing   items,   attention was directed  toward  the  adequacy
and accuracy   of the  content,   format,   styles   and readability.     In  general,
most   items  have   a  sixth-grade  reading  leve!3   although many   items   contain
some computer-related  technical words   that  might   not   be   familiar   to  the
average  sixth-grade  student,

Field Testing.     The  purpose  of  the   field test  was   to  conduct   a   forma-
tive  evaluation of  the  preliminary  survey  and validation questions.     Although
the  questions had been developed  through  several   iterations  and  reviews
by   technical  experts,   they had  not  been  tried out with  the superintendents,
principals,   teachers,   and  students who were  to be  the ultimate   target
group.     The   evaluation focused  on the responses   of   individuals   from each
of  these groups   to  the  language   and   substance of  the   items.e will depend on the
